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Abstract 

In this paper we advance the entropy theory of discrete nonautonomous 
dynamical systems that was initiated by Kolyada and Snoha in 1996. The 
first part of the paper is devoted to the measure-theoretic entropy theory 
of general topological systems. We derive several conditions guaranteeing 
that an initial probability measure, when pushed forward by the system, 
produces an invariant measure sequence whose entropy captures the dy¬ 
namics on arbitrarily fine scales. In the second part of the paper, we apply 
the general theory to the nonstationary subshifts of finite type, introduced 
by Fisher and Arnoux. In particular, we give sufficient conditions for the 
variational principle, relating the topological and measure-theoretic en¬ 
tropy, to hold. 
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1 Introduction 


In recent years, properties of discrete nonautonomous dynamical systems 
(also called nonautonomous discrete systems, sequential/nonstationary/time- 
dependent dynamical systems or mapping families) have been studied a great 
deal. While a discrete autonomous or classical dynamical system is given by the 
iterations of a single map f : X ^ X, the dynamics of a nonautonomous system 
is generated by compositions of different maps. Given a sequence /„ : X —5> X, 
n = 0,1,2,..., the trajectory of an initial point ccq S X is the sequence de¬ 
fined by Xn = fn-i{xn-i)- Without severe restrictions on the sequence {fn)'^^o 
such as periodicity or stationarity with respect to some probability distribu¬ 
tion, it is intuitively clear that the range of phenomena to be observed in such 
systems is largely broader than what can be seen in autonomous dynamics. 
Many concepts used intensively in classical dynamics such as periodicity and 
recurrence do not seem to make sense for nonautonomous systems, while other 
concepts such as correlation decay, hyperbolicity or entropy can be generalized 
and to some extent are still useful to describe the properties of such systems 
(see [XFl E KSl IKM^ iLYl lOW] , for instance). 

In this paper, we concentrate on the study of metric (i.e., measure-theoretic) 
and topological entropy. For a sequence of continuous maps on a compact 
space, topological entropy was introduced in [KSj and generalized to systems 
with time-varying state space (i.e., /„ : X„ —>■ X„+i) in [KMSj . Measure- 
theoretic notions of entropy were first established in [0111]. While the notion 
introduced in 0 still assumes a stationary measure, which for a nonautonomous 
system only exists under very restrictive assumptions, the notion in [Kl] is 
completely general, though not canonical, since it depends on a given class of 
sequences of measurable partitions satisfying certain axioms. However, for a 
topological system, given by an equicontinuous sequence of maps /„ : X„ —>■ 
X„+i between compact metric spaces, a canonical class can be defined and 
the associated metric entropy of any invariant sequence of Borel probability 
measures on the spaces X„ does not exceed the topological entropy (cf. [KIl 
Thm. 28]). This establishes one (usually considered the easier) part of the 
variational principle. The question for which class of systems the inequality 
between metric and topological entropy can be extended to a full variational 
principle is still far from an answer. A first obstacle to a generalization of the 
classical proofs is that in general it is not known whether the allowed class of 
measurable partitions contains elements of arbitrarily small diameters. 

In the first part of the paper, we thus aim at a characterization of those invari¬ 
ant measure sequences (shortly IMS) which allow for arbitrarily fine scales in 
the computation of their entropy (called fine-scale IMS). We are able to provide 
several sufficient conditions, which however all have their limitations, meaning 
that they are far from being necessary. In fact, we have to leave the question, 
whether every IMS (under obviously necessary conditions) has such a property, 
open. Nevertheless, we can show that a system has at least one fine-scale IMS if 
and only if the sequence (X„)))Tg of compact metric spaces is uniformly totally 
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bounded. Furthermore, we prove a product theorem for the entropy of sys¬ 
tems with fine-scale IMS and we show that our notion of metric entropy indeed 
generalizes the classical notion of Kolmogorov and Sinai. 

The second part of the paper is devoted to the computation of metric and topo¬ 
logical entropy of nonstationary subshifts of finite type (shortly, NSFT’s), that 
were first investigated in [AFl IF] with the motivation to study uniformly hyper¬ 
bolic mapping sequences via coding and to deduce properties of adic transfor¬ 
mations, respectively. While a classical subshift of finite type is given by a finite 
alphabet A and a transition matrix L, in the nonstationary case time-varying 
alphabets and matrices, i.e., sequences {An)^=o and (Tn)((TQ, are allowed. The 
dynamics is still given by the left shift operator, but now the domain of this op¬ 
erator is no longer invariant but also varies in time. That is, we have a sequence 
of maps between different sequence spaces, and each map is a restriction of the 
shift. Putting the word metric on each of the spaces, we obtain a formula for the 
topological entropy that is completely analogous to the classical one, namely 

htop =limsup-log||Lo-bi---T„-i||, 

n—¥oo ^ 

which reduces to the log of the spectral radius of L in the stationary case. For 
the metric entropy we can show that every IMS of an NSFT is a fine-scale 
IMS. In the explicit computation we concentrate on a special IMS introduced 
by Fisher that he constructed analogously to the Parry measure in the classical 
theory. While the Parry measure is the unique measure of maximal entropy for 
a stationary subshift, for a Parry measure sequence (which is not even uniquely 
defined) we can only show a similar result under additional conditions on the se¬ 
quence {Ln)'^^Q. For instance, a simple sufficient condition implying the equality 
of metric and topological entropy (and hence the validity of the variational prin¬ 
ciple) is that the sequence (Tn) is uniformly primitive, i.e., there is an integer 
m, such that for each i all entries of LiLi+i ■ ■ ■ Li+rn are strictly positive. 

The paper is organized as follows: In Section [5] we introduce notation, give the 
definitions of the main quantities, and recall some of their properties. Section [3] 
contains the results on general topological nonautonomous systems, in particular 
the results on fine-scale IMS. The main results are Theorem 13.31 about the 
computation of the metric entropy on admissible sequences of arbitrary small 
diameters and Theorem 13.81 about sufficient conditions for the existence of such 
sequences. Section |4] contains the results about nonstationary subshifts of finite 
type, in particular Theorems 14.5114.131 and 14.141 about their entropy. 


2 Preliminaries 

A nonautonomous dynamical system (an NDS, for short) is given by a pair 
(Aoo,/oo), where Xoo = (Al„)()Tg is a sequence of sets and /oo = (/n)))Tg a 
sequence of maps /„ : X„ Xn+i- For all fc > 0 and n > 1 we put 

fk ■= fk+n-i o • ■ • o fk+i o fk, := idx, . 
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Moreover, we define /^T" := which is only applied to sets. (We do not 

assume that the maps /„ are invertible.) The trajectory of a point x G Xq 
is the sequence {fo{x))'jjLo- By {Xn,oo, fn,oc,) we denote the pair of shifted 
sequences Xn,oo = = (/r!.+fc)^o similar notation 

for other sequences associated with an NDS. If such a sequence is constant, 
we drop the subscript “oo”, e.g., we write X instead of Xoc, if Xn = X. If 
each Xn is a compact metric space with associated metric dn and the sequence 
/oo is equicontinuous, meaning that for every s: > 0 there is 5 > 0 such that 
the implication dn(x,y) < <5 => dn+i(.fn{x), fn{y)) < £ holds for all x,y G Xn 
and n > 0, we speak of a topological NDS. The assumption of equicontinuity 
rather than mere continuity of each /„ is usually not part of the definition of 
a topological NDS (see lElKS]). However, since it is essential for most results 
about topological entropy, including the power rule and the relation to metric 
entropy, we include it in the definition. 

For a topological NDS, the topological entropy h.top(/oo) is defined as follows. 
For each sequence Uoo = {ldn)'jjLo of open covers Un of we put 


^ n—1 

^top(/oo;^oo) := limsup - logA/'(^ \/ 


2=0 


where V is the usual join operation for open covers and A/"(') stands for the 
minimal number of elements in a finite subcover. We write C^X^a) for the family 
of all sequences Uoo of open covers whose Lebesgue numbers are bounded away 
from zero and define the topological entropy of /oo by 


^top(/oo) ■ sup I^top (/oo 7 ^oo) ■ (1) 

u^ecix^) 

Unlike in the autonomous case, this quantity depends on the metrics dn, and 
not only on the topologies of the spaces Xn- However, in the autonomous case, 
o gives the classical notion of topological entropy, which can be seen from the 
fact that htopifoo) can also be dehned via (n, £)-separated or (n, e)-spanning 
sets as follows. We introduce the Bowen-metrics 


dkA^^y) ■= ma? dk+i{fl{x),fl{y)), k>0, n > 0, 

on each of the spaces X^. A subset E C Xk is called {n,e; fk,oo)-separated 
if dk,n{x,y) > £ holds for each two distinct points x,y G E. A set F C Xk 
(n,£] fk^oo)-spans another set K C Xk if for each x G K there is y G F 
with dk^n(x,y) < e. In the case fc = 0, we also speak of (n,£)-separated and 
(n, £)-spanning sets. We write r’sep(n, s; fk,oo) for the maximal cardinality of an 
(n, e; //c^oo(-separated set and rspanin, e; fk,oo) for the minimal cardinality of set 
which (n, e; /fc,oo(-spans Xk- For each e > 0 we define the numbers 

hsep{£,fac) ■= limsup-logrsep(n,e;/oo), 

n—¥oc 

^span ■ lini sup log ^span ^oo) • 

n—¥oc U. 
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As in the autonomous case, it can be shown that (cf. [KSl IKMS] ') 


^top(/*oo) — lim foe') — lim hspan (^5 foo') ^ 

e\0 e\0 

where the limits can be replaced by supg^g. 

Let /Too = be a sequence of Borel probability measures for the metric 

spaces Xn such that /„/r„ = where /„ here denotes the push-forward 

operator on measures, defined by (/„^)(A) := We call such ^oo an 

invariant measure sequence (IMS) for (Xqo, foe) and associate to (AToo, foo, Moo) 
a family = SuifJ'oc) of sequences of finite Borel partitions as follows. A 
sequence 'Poo = (Pn)5)^oi where P„ = ... ,Pn,k„} is a Borel partition of 

Xn, belongs to iff the sequence (fc„)^g is bounded and for each e > 0 there 
are 5 > 0 and compact Kn,i C Pn,i such that for all n > 0 the following hold: 

(a) {Pn,i\Xn^i'} Si ^ for i — 1, . . . , 

(b) for all 1 < z < j < fc„, 

Kji j^ .— min dnix^y') ^ 6. 

{x,y)GK„^iXKn,j 

We call the sequences Poo S admissible. The metric entropy of foo w.r.t. Poo 
for an arbitrary sequence Poo of finite Borel partitions P„ is defined as 

h{foo,yoo\Poo) := limsup-iL^o( Y fo^P^, 

n—¥<X) ^ • rv ' 

i—Q 

where iL^o(P) = — mo(^’) log Mo(^’) is the usual entropy of a partition. 

If the IMS Moo is clear from the context, we will often omit this argument. The 
metric entropy of foo w.r.t. yoo is given by 

b.{,fOO^ dco) • sup Iz(y*oo ) Moo 5 Poo) ■ (2) 

■PcxiS^M 


In [KIl Thm. 28] the inequality 


hifoo,yoo) < htopifoo) (3) 

was proved. If the equality 

b.topifoo') — sup/l(yoo: Moo) (4) 

Moo 

is satisfied, the supremum taken over all IMS, we say that (Xoo, foo) satisfies a 
full variational principle. 

Two topological NDS {Xoo, foo) and (Too,5oo) are called equi-semiconjugate 
if there exists an equicontinuous sequence tToo = surjective maps 

7r„ : Xn —>■ Yn such that 7r„+i o /„ = o 7r„ for all n > 0. The sequence tToo 
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is then called an equi-semiconjugacy. In this case, htopigoo) < htopifoo)- If the 
sequence tToo consists of homeomorphisms and also (7r“^)5^Q is equicontinuous, 
then TToo is called an equi-conjugacy and htopifoo) = htopigoo)- 

We end this section with the following simple observation: 

2.1 Proposition: Let (Xocfoo) be a topological NDS such that each fn is 
surjective. Then htopifk.oo) = htop{fi,oo) for all kj >0. 


Proof: By [KSl Lem. 4.5] we have htopifk,oo) < htop(/fc+i,oo) for all k > 0. 
The other inequality follows from the fact that the sequence fk,oo is an equi- 
semiconjugacy from fk,oo to /fe+i,oo 5 i-e., from the commutative diagram 


Xfe -^ Xfe+i Xk+2 


fk 


/fc+1 


fk + 2 







Xk+l — - > Xk+2 —Z - > Xk+3, 

Jfc+l Jk+2 


fk + 2 

- . . . 


- . . . 

fk + 3 


This implies htopif k+i^oo) ^ htopif k,oo) for all k ^ 0. 


□ 


3 Fine-scale sequences 

In this section, we first prove a result which in many cases reduces the compu¬ 
tation of the metric entropy hifodJtoo) to the computation of /i(/oo,/ioo; Poo) 
for countably many Voo- The proof of this result is based on the inequality 

^ n —1 

hifoo'^Voo) < h(/oo; Qoo) -f limsup - H^.i'Pi\Qi), 

that was shown in [kTI Prop. 9(vi)] and will be used to approximate hifoo', Voo) 
for arbitrary Voo G by the entropy on the elements Qoo of a countable subset 
of • To estimate the conditional entropy Hf^. (Pi | Qi) we will use a result saying 
that the Rokhlin metric on the set of all partitions (of a probability space) of 
fixed cardinality m is equivalent to another metric defined via the measures of 
symmetric set differences. For us, the crucial point of this result is that this 
equivalence is uniform with respect to the probability space (at least in one 
direction). This is made precise in the following lemma whose proof can be 
found in |KH1 Prop. 4.3.5]. 

3.1 Lemma: For every integer m > 2 and e > 0 there exists (5 > 0 such that the 
following holds: Let [X, A, fj.) be a probability space and let V = {Pi,, Pm}, 
Q = {Qi, • • ■) Qm} be two measurable partitions of X. Then the implication 

m 

m^J2hiP^f^Qa{i)) <s ^ Hf,iV\Q) + H^iQ\V) < e 

2=1 
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holds, where the inhmum is taken over all permutations a of {1,, m}. 

3.2 Definition: If is a sequence of compact metric spaces and 

Voo = {'Pn)^^o Sin associated sequence of partitions, we call 

diamPoo := sup sup diamP, 

n>0 P^Vn 


the diameter ofVoo, where diamP = sup,^ y^p dn{x,y). 

3.3 Theorem: Let {Xao, fao) be a topological NDS with an IMS fXoo- Assume 
that there exists a sequence ('P.^)^o ^ Suif^oo) such that 

lim diamP^ = 0. 

k—>co 

Then the metric entropy satisfies 

h{fooj Poo) — ^(/ooj Moo: "^oo) ~ ^{.f oot Poo't'f^oo)' 

k>Q k^oo 

Proof: Since we assume 7^^ G £m{Poo): we clearly have 


^(y *005 Poo) ^ sup h(^f(yQ 5 Poo 1 P^). 
k>0 

To prove the converse inequality, consider an arbitrary Voo G SuiPoc)- By 
adding sets of measure zero, we may assume that each P„ has the same 
number m of elements, say P„ = {Pn,i, ■ ■ ■, Pn,m}- For a given e > 0 we 
choose 6 = S{m + l,e) according to Lemma ITTI Since Poo & Sm, there exist 
p = p(5) > 0 and compact sets Kn,i C Pn,i such that Pn(,Pn,i\Kn,i) < Sjm and 
Dn{Kn,i,Knj) > p iov i ^ j. Choose k large enough so that diamP^ < p/2. 
For each of the sets Kn.i consider the union of all elements of P* that have 
nonempty intersection with and denote this union by Qn,i- This im¬ 

plies Qn,i n Qn,j = 0 for i ^ j. Together with the complement Qn,m+i '■= 
Xn\\JiLi Qn,i, we obtain a new partition 

Qn — : Cn,m-t-l}; 

and we consider the sequence Qoo := {Qn)'//Lo- compare h{foo', Qoo) 

with h(/oo;P^) and /i(/oo;Poo) with h{foc', Qoo)- Since P* is a refinement of 
Qnj by [Kll Prop. 9(iii)] we have 

M/oo; Qoo) <M/oo;Pa¬ 
using [Kll Prop. 9(vi)], we get 


^ n —1 

Kfoo] Qoo) > ^(/oo;Poo) - limsup - W Hy,.{Vi\Qi). 

„ __ n A—^ 


2=0 
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Adding the empty set to 7^„, we obtain a partition 


'Pn — {-Pn,l! 


1 Pn,7n: Pn,m+1 }; 


P, 


n,m+l — 


with Hf_,^{'Pn\Qn) = Hfj,^{Vn\Qn)- We have 


f^niPn,i\Qn,i) ^ f^n{Pn,i\Pn,i^ ^ 

m 


for i = 1 ,..., TO and 

f^n{Qn,i\Pn,i) — ^ f^n{Qn,i bl-Pnj) ^ ^^5 

TO 

since is disjoint from Moreover, /i„(Pn,m+i\<3n,m+i) = 0 and 

/rn(Qn,m+i\-Pn,m+i) ~ /rn(Qn,m+i) ^ Hence, the choice of S yields 
H^^{Qn\Pn) < e, implying h(/oo;7^^) > h{foo;Poo) - e. Since e was cho¬ 
sen arbitrarily, this proves the inequality /i(/oo,/ioo) < supj,>o/i(/oo,/ioo; 72.^)- 
To see that the supremum over k is equal to the limit for fc —>■ oo, observe that 
for each e > 0 there is Poc S £m with h{foo,^ao',Poo) > /i(/oo,/ioo) — e/2 and 
there is ko such that h(/oo, A^oo; > Hfoo, k-oolPoo) - e/2 for all k > ko. 
Hence, h{foo,koG) > h{foo;P'^) > h{foo,koo) - e for all k > ko. □ 

For many arguments in the classical entropy theory it is essential that one can 
use partitions of arbitrarily small diameter. To establish a reasonable entropy 
theory for NDS, it hence is important to understand under which conditions 
there exist admissible sequences with arbitrarily small diameters as required in 
the preceding theorem. This motivates the following definition. 

3.4 Definition: Let {Xoo, foo) be a topological NDS with an IMS poo- We call 
a sequence (T’^)^o ™ ^m(Moo) a fine-scale sequence if diamT"^ —>• 0. The IMS 
Poo is called a fine-scale IMS if there exists a fine-scale sequence in £m{Poo)- 

The next proposition summarizes elementary properties of systems with fine- 
scale IMS, see also Proposition l3.17l 

3.5 Proposition: The following assertions hold: 

(i) A topological NDS {Xao, foo) has a fine-scale IMS iff the sequence X^c, is 
uniformly totally bounded, i.e., for each a > 0 there is m € N such that 
TO balls of radius a are sufficient to cover for any n > 0. 

(a) Let {Xoo, foo) and (Too, 5 oo) be topological NDS that are equi-conjugate 
via TToo = ( 7 r„)j^Q. Then, if p^o is a line-scale IMS for {Xoo, foo), the se¬ 
quence Voo = ii^n)^=o given by Un = •XuPn is a fine-scale IMS for (Too, 5oo)- 

(Hi) Let {Xoo, foo) and (Too, goo) be topological NDS with fine-scale IMS poo 
and Voo, respectively. Then poo x Voo, defined componentwise by pn x i/„, 





is a fine-scale IMS for the direct product system {X^o x Yoc/oo x (?oo) 
(also defined componentwise) and 

Xl/oo) (/oo X 5oo) ^ ^£m(Mcxj) (/oo) Y ^fM(l'oo)(5 C5o)j (5) 

where on x y„ we use the product metrics 

dn((xi,yi),(x 2 ,y 2 )) = max{d^(a;i, ^ 2 ), ^ 2 )}- 

Proof: To prove (i), assume that p,cc is a fine-scale IMS for (Xoo,/oo)- Then 
for each a > 0 we can find an admissible sequence Poo with diamPoo < The 
fact that Poo is admissible in particular implies 4(Vn < m for some m S N. 
Since each P G Vn is contained in the a-ball around any x G P, we see that m 
a-balls are sufficient to cover X„, and hence X^o is uniformly totally bounded. 
Conversely, assume that X^o is uniformly totally bounded. Let /ig := Sxq for an 
arbitrary xq G Xq and consider the IMS = /qP-o = Tor any given 

Of > 0 choose m so that m balls of radius a /2 are sufficient to cover for each 
n. From such a ball-cover of one easily constructs a measurable partition 
P„ = {Pn,i,..., Pra,m} with m elements such that diamP„ < a, by cutting 
away the overlaps between the balls. It is easily seen that such a sequence 
Poo = (Pn)5^o is admissible. Indeed, for any e > 0 let iC„,i C Pn,i be defined 
by Kn^i := ifoixo)} if foixo) G Pn,i and := 0 otherwise. Then 
is a compact subset of P„^i and the conditions that Pn{Pn,i\Kn,i) < e and 
dn{x, y) > 6 > 0 and x G Kn,i, y G Knj (i 7 ^ j) are trivially satisfied. 

For (ii) we note that in [KH Prop. 27] it was proved that i/oo is an IMS for 
(Yoojffoo) and Suipoo) and Suivoo) are isomorphic in the sense that Poo = 
{'Pn))(Lo G SuiPoc) iff i'XnPn)')DLo ^ From the equicontinuity of tt^ it 

easily follows that a fine-scale sequence in £m(Poo) yields a fine-scale sequence 
in £m(i^co) via this isomorphism. 

Finally, let us show (iii). It follows from a simple computation that the sequence 
(pn X r'n)/To of Borel probability measures on the spaces x is an IMS for 
the product system (Xca x Yoc/oo x goo)- By the assumption, we can choose 
for any given a > 0 sequences Poo G £m(Poo) and Qoo G £’m(j^oo) such that 
diamPoo, diam Qoo < O- Consider the sequence Poo x Qoo of product partitions 

Pn X Qn := {P X Q : P G Pm Q s Qn} j 71 > 0. 

For each P x Q G Pn x Qn we hnd diam(P x Q) < a in the product metric 
hence diam(Poo x Qoo) < ct. We claim that Poo x Qoo is in Eyi{poo x lyoc)- 
To show this, assume P„ = {P„,i, ..., Pn,k„} and Q„ = {Qn,i, ■ ■ ■, Qn,t„}- For 
a given e > 0 let di = (5(Poo,e/2) > 0 and ^2 = S(Qoo,s/2) > 0 as well as 
compact sets Kn,i C Pn,i and Ln^i C Qn,i be chosen according to the definition 
of £m ■ Then 

pn X l^n {{Pn^i X Qn,i)\(Xn^i X Ln^i)) 

— pn X r'n (iPn,i\Xn,i) X Qn,i C Pn,i X (Qn,i\Pn,i)) 

£ £ 

^ pn{Pn,i\Xn^i)r^n(Qn,i) T pn{Pn^i)k'n{Qn,i\Pn,i) ~ 2 ^ 
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Moreover, for (xi,yi) £ Kn^i^ x and {x 2 ,y 2 ) G Kn,i 2 x Lnj^ with (ii,ji) ^ 
(*2,j2) we have 

((a;i, 2 /i), {X2,y2)) = max {d^{xi, X2), {yi,y2)} > min{( 5 i, < 52 } =: 6 > 0 . 

This proves the claim. Consequently, since a was chosen arbitrarily, /ioo x ^00 
is a fine-scale IMS. It remains to prove the entropy inequality. First note that 
for Voo G Suiy-oc) and Qoo G £m{i^oc) we have 

Hfoo X goolVoo X Qoo) = limsup-i7^oxi/o( V (•^0 x 2*)) 

n—>^00 ^ ^ ' 

2=0 

^ n—1 n—1 

= lim sup-17^0X1.0 ( V X Y go'Q^)■ 

n—>00 ^ • n • n ' 

2=0 2=0 

For any measures y, v and partitions V, Q the identity H^y,y{V x Q) = H^{V) + 
Hv{Q) holds, as can easily be seen. This gives 

^(^foo X ^00 7 "^OO X Qoo) ^ h(_/*oO:T^Oo) “t“ h(^0O7 Qoo)- 

The inequality ([S]) now follows by considering Voc and Qoo of arbitrarily small 
diameter and applying Theorem 13.31 to the product system. □ 

3.6 Remark: In general, we cannot expect equality in ([S]), since the corre¬ 
sponding limsup’s for sequences Voo x Qoo, 'Poo and Qoo may be attained on 
different subsequences. See also Hulse El for counterexamples to the product 
formula for sequence entropy and topological entropy on non-compact spaces 
that could be adapted to produce a counterexample for the equality in 

To find sufficient conditions for determining whether a given IMS is a fine- 
scale IMS, we first consider systems with stationary state space = X. For 
the stationary case, in Theorem 13.81 and Corollary 13.111 below we give sufficient 
conditions for the existence of fine-scale sequences {V^)’k=o with each being 
a constant sequence, while in Proposition 13.151 we show an example for which 
such sequences do not exist. 

3.7 Definition: We say that a topological NDS {Xoo,foo) has a stationary 
state space if all {Xn,dn) are identical, i.e., {Xn,dn) = {X,d). In this case, we 
simply write (X,foo) instead of {Xoo,foo)- Given an IMS poo of {X,foo), we 
write yV(yoo) for the set of all weak* limit points of /ioo- 

3.8 Theorem: Let {X, foo) be a topological NDS with stationary state space 
and an IMS poo- Then, under each of the following conditions, there exist 
line-scale sequences (T’^)^o constant 

(i) The set {yn}^=o is relatively compact in the strong topology on the space 
of measures. 
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(ii) For every a > 0 there is a finite measurable partition V of X with 
diam'P < a such that every P satisfies v{dP) = 0 for all v G >V(/roo)- 

(Hi) The space X is zero-dimensional. 

(iv) X = [0,1] or X = and there exists a dense set D C X such that every 
X G D satisfies i^Hx}) = 0 for all v G W{poo)- 

Proof: Under condition (i), it was proved in m Prop. 31] that £m contains 
all constant sequences. 

Assume (ii). For a given a > 0 let P = {Pi,...,Pk} be a partition with 
diamP < a and v{dV) = 0 for all v G W{poa)- We claim that the constant 
sequence P„ = P is admissible. To prove this, let e > 0. For every iz G 
W{poq) and every i G {1,...,A;} we find a compact set K)) C Pi such that 
v{Pi\K'() < e/2 and v(d{Pi\K'()) = 0 (see |K1[ Lem. 33] for the existence of 
such iF/). By the Portmanteau theorem, there exists a weak*-neighborhood 
Uy of V such that every p £ Uv satisfies \p{Pi\K0) — v{Pi\K'()\ < e/2 for 
i = 1,..., fc. By compactness of W{poo), finitely many such neighborhoods, say 
Ui = t/yj ,... ,Ur = are sufficient to cover W{poo)- By standard arguments, 
it follows that there exists no > 1 such that Pn S Uj=i all n > uq. For 

all n G {0,..., n-o — 1} we can find compact sets iff C Pi with pn{Pi\K(^) < e 
for i = 1,..., fc. Let 

r uq — I 

fF, := U U U iF/, *=l,...,fc. 

j—1 n—0 

Then Ki is a compact subset of Pi. For every n > no we find G {1,..., r} 
such that pn G , implying 

Pn{Pi\Ki) < pn{P^\K''^’') < nj„(P,\Ar/"") + f ^ I + I = 

For n < no we have pn(Pi\Ki) < pn[Pi\K0‘) < e, proving the claim. 

Now assume that condition (iii) holds. Then the topology of X has a base con¬ 
sisting of clopen sets (in fact, this is one possible definition of a zero-dimensional 
space). Lienee, we can find for each a > 0 a partition P = {Pi,...,Pfe} 
of X with compact sets Pi satisfying diamP^ < a for i = l,...,/c. Let 
5 := m.miyj D{Pi, Pj). By compactness we have d > 0, which obviously im¬ 
plies that P„ = P is contained in Em- 

Finally, suppose that (iv) holds. We only give the proof for X = [0,1], since for 
it is very similar. We first prove that for every x G D the following holds: 

Ve > 0 3d > 0 : Vn > 0, pn{Bs{x)) < e. 

To show this, we argue by contradiction, i.e., we assume that there exists e > 0 
such that for every d > 0 there is n = n(d) with pn{Bs{x)) > e. Let (dfe)^g 
converge to zero and let Uk = n{6k), i.e., 

hrikiBs^ix)) > £ for all fc > 0. 
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We may assume that weakly*-converges to some /i. Then we may replace 
the numbers Sk by slightly bigger numbers so that the convergence to zero still 
holds, but now ii{dBs^{x)) = 0. Fix any fc* > 0. Using the Portmanteau 
theorem and the fact that Bs^{x) C Bg^^ (x) for sufficiently large k, we find 

(a;)) = lim linkiBSk, {x)) > £■ 

k—¥oo 

Letting fc* —>■ oo, we thus obtain the contradiction /i({a;}) > e. Now, for a given 
a > 0, we partition the interval [0,1] into subintervals of uniform 

length 1/k, where k > 2/a and suplj = inf/j+i. By the claim, we can pick 
Xj € Ij for j = 1,..., fc such that 

Ve > 0 3(5 > 0 : Vn > 0, j = 1,..., fc, ^,n{Bg{xj)) < e. (6) 

Let the partition V consist of the subintervals Pi := [0,a;i), P 2 := [xi.x^.), ■ ■ ■, 
Pk+i '■= [xk, Ij- Then diamT^ < 2/k < a. To show that the constant sequence 
Vn = V is admissible, let e > 0 and pick 5 = 8{e/2) according to (O- Define 
compact sets 

Kj ■= {a; G Pj : dist(a;, dPj) > 5/2} , j = 2,..., fc, 

Ki ■—{x & Pi : \x - xi\ < 5/2] , Kk+i ■■= {x & Pk+i : \x-Xk\<5/2}. 

This implies that any two Kj have distance > 5 and iJ,n{Pj\Kj) < e. □ 

3.9 Remark: We note that condition (ii) in the preceding theorem is remi¬ 
niscent of the small boundary property in the entropy structure theory of au¬ 
tonomous dynamical systems (cf. Downarowicz iPTilrn]!. Here partitions of 
a space X are of interest with boundaries of measure zero w.r.t. all invariant 
measures of a given map T on X. 

From Theorem 13 . 31 combined with Theorem l3.8f il or (ii) we immediately obtain 

3.10 Corollary: For an autonomous measure-preserving dynamical system, 
the metric entropy defined as in m is the same as the usual Kolmogorov-Sinai 
metric entropy. 

In the next corollary we formulate conditions that are easier to check than the 
conditions in Theorem 13.81 

3.11 Corollary: Let {X, /oo) be a topological NDS with stationary state space 
and an IMS p,oo ■ Then, under each of the following conditions, there exist fine- 
scale sequences {Px)'^=o constant P^. 

(i) yV{p,oo) contains at most countably many non-equivalent measures. 

(ii) X = [0,1] or X = and at most countably many p G VV(/ioo) admit 
one-point sets of positive measure. 
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(in) The space X is of the form X = Y x I with a compact metric space Y 
and pn = VnX X, where X is the standard Lebesgue measure on I = [0,1]. 

Proof: Under condition (i) it can be concluded from Theorem 13.Sf iil that the 
assertion holds. Indeed, by |D21 Fact 6.6.6], for any countable family of proba¬ 
bility measures of a compact metric space, there exist arbitrarily fine partitions 
with boundaries of measure zero w.r.t. all measures in this family. 

Under condition (ii) the proof follows from Theorem l3.8l iv'): Let {i^a}aeA be the 
set of all elements of W(^oo) that admit one-point sets of positive measure and 
let Aa := {x G X : Ua{{x}) > 0}. Then Aa is countable, since otherwise one 
of the sets {x G X ■. h'a{{x}) > 1/fc}, fc S N, would be infinite in contradiction 
to the finiteness of Va. As a consequence, also A := countable, and 

hence D := Ar\A is dense in X. For every x G D we have v({x)) = 0 for each 
V G yV{poo)- This shows that condition (iv) in Theorem 13.81 is satisfied. 

Under condition (iii) the proof follows from Theorem I3.8f iil. Indeed, we can 
construct partitions of X with arbitrarily small diameters and zero boundaries 
with respect to all probability measures of the form p x X on Y x /, so in 
particular for all elements of W{poo x A), as follows. Take a continuous function 
ip :Y ^ I and define 

:= {(y,t)eUx/ : t>ip{y)}, 

■= {(y,t)eUx/ : t<ip{y)}. 

This yields the measurable partition V{(p) = {P°‘{(p),P^((p)}. For finitely 
many continuous functions pi,, ipm ■ Y -A I we also define the partition 
V{pi ,..., (fim) ■= VjLi We observe that dP°'(ip) U dP^{if>) C Graph((/j). 

For any partition of I into subintervals Ii, I 2 ,. ■., Ir of length 1/r, 

r 

Graph((^) C |J x Ij, 

j=i 


implying 

(p X A)(Graph((/?)) < ^ p((p-^(Ij))X(Ij) = i. 

1=1 

Hence, (p x X){dP°'{(p)) = (p x X){dP^{(p)) = 0. Since the elements of 
... ,ipm) are finite intersections of sets with zero boundaries w.r.t. all 
p X X, their boundaries also have this property. According to m Sec. 6.2] we 
can choose so that diam'P((^i,..., pm) —>■ 0 for m ^ 00 . □ 

3.12 Remark: Here is a possible application of condition (iii) above: Consider 
the identity map id : / —>■ / and note that htop(/oo x id) = htop(/oo), which 
is easy to prove. However, in general we don’t know if h£^(^^xA)(/oo x id) = 
^eM(Aioo)(/oo)- Proposition 13.171 given below yields this equality only under the 
assumption that poo is a fine-scale IMS. Now condition (iii) shows that poc x A is 
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always a fine-scale IMS for foo x id. Hence, it might be easier to compute lower 
bounds for /itop(/oo) in terms of the metric entropy of the product system foo x id 
than by using foo- Condition (iii) together with Proposition 13.171 also shows 
that for a fine-scale IMS one can always use constant sequences of partitions to 
compute the metric entropy by passing over to the product (foo x id,/ioo x A). 

With regard to condition (i) in the preceding corollary, we note that the number 
of non-equivalent elements of yV(fJ-oc) is not an invariant with respect to equi- 
conjugacies, see Example l3.14l below. This is very interesting, because according 
to Proposition l3.5l iil. equi-conjugacies preserve the property of being a fine-scale 
IMS. Hence, we can formulate the following corollary. 

3.13 Corollary: Let {Xoo,foo) be a topological NDS with an IMS poo- Let 
V be a compact metric space and iTn : Xn —>■ V homeomorphisms such that 
{'^n)^=o cLnd (7r“^)5^Q are equicontinuous. If there are at most countably many 
non-equivalent measures in W((7r„/i„)5^g), then poo is a fine-scale IMS. 

3.14 Example: Let S^ C C be the unit circle and consider a map / : S^ —>■ S^ 

with a dense forward orbit {/"(iro)}^o irrational rotation or the angle 

doubling map). Let /„ := / for every n > 0 and put po := Sxg, Pn ■= /"Mo = 
Sfn(^xo)- This IMS has every Dirac measure a: € S^, as a limit point. Choose 
for each n a rotation 7r„ : S^ —> S^ such that 7r„(/"(a;o)) = 1. Then {tt^} and 

are equicontinuous and 7r„/x„ equals (5i constantly. 


We next present an example of an NDS on the unit interval, which does not 
admit constant admissible sequences of partitions into subintervals of arbitrarily 
small diameters. We will use the following lemma. 

3.15 Lemma: Let n € N and J C (0,1) be a compact interval of length 2“". 
Then there are k = k{n) G N and continuous piecewise afhne maps /i,..., /^ : 
[0,1] —>■ [0,1] such that 

(i) For every i G {1,..., fc}, the restriction : fl~^(J) -y fi{J) is an 

isometry. 

(a) For every x with < x < 1 — there is i € {!,..., k} with 

X G /i(J) and dist(x, 9/|( J)) > 

(iii) \fl{x)\ < 1 for i = 1,... ,k and all x such that /'(x) exists. 


Proof: Consider the intervals 

J,. ■■= 


iii 


i i +1 

2^+2 ’ 2"+2 ^ 2 " 

— 

2 n +2 ’ 2'^+2 


l<i< 2"+2 -5=:k. 


Let X G [2 1"+^), 1 — 2 ("-+!)]. Then x is contained in an interval of the form 
i i + l 


2n+2 ’ QLi-\-2 


i G {2,...,2"+2 -3}. 
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This implies x S Ji-i- Moreover, (list(a;,9Ji_i) > 2 ("+ 2 )^ because 

i— 1 i i — 1 1 

T — - ^ = - 

2^+2 — 2 ^"*”^ 2 ^"*”^ 2 ^"*”^ 

and 

i — 1 1 i — 1 1 i + 1 1 

- _|_ - — T ^ - -I- - — - ^ - 

2^+2 — 2 ^"*”^ 2 ^^ 2 ^“^^ 2 ’^"*”^ * 

The maps are constructed as follows: if J = [ 0 , 6 ], then fi can be 

chosen as a piecewise affine map with /i(a) = /i(^) = 2 “^"+^^ + 2 “" 

such that /i has slope 1 on [a, &] and slope < 1 on [0, a] and [b, 1]. The maps ft 

for 2 < i < k are chosen similarly, mapping Ji-i to Ji isometrically. □ 

3.16 Proposition: There exists an NDS (/, foo) on the unit interval I with an 
IMS /ioo such that Smihoc) does not contain any constant sequence of partitions 
into subintervals of diameter less than one. 

Proof: The proof proceeds in two steps. 

Step 1. Informally, the idea of the construction is as follows: we start with the 
standard Lebesgue measure as an initial measure /tq and choose the first map 
/o in the sequence so that it scales the Lebesgue measure down to an interval of 
length 1/2. Then we apply finitely many maps that just translate the support of 
the scaled-down Lebesgue measure around the unit interval so that many points 
will be contained in the interior of the support with some uniform distance to 
the boundary. Then we scale down by factor 1/2 again and move the support 
around in the same fashion, and so on. By this construction, the support of the 
measure becomes a smaller and smaller interval when n becomes large, and is 
moved around all over the interval. 

Formally, we construct foo as follows. The map /o is an affine map of slope 1/2 
such that the interval Jq := /o(f) C (0,1). Then /i,..., /„j are piecewise affine 
maps chosen according to Lemma lS. 151 with J = Jq, n = 1 and ni = k{l). Next, 
fm+i is chosen to be an affine map of slope 1/2 that maps fo^'^^il) = 
into (0,1). Again, fni+ 2 , ■ ■ ■, fn^ are piecewise affine maps chosen according to 
Lemma [3. 151 with J = /"^(Jg), n = 2 and n 2 = rii + k{2) + 1. Going on in this 
way, we produce a sequence foo = (/n)^o daat has the following property: 

For every x € (0,1) there is an ng such that for all n > ng, x is contained in a 
subinterval C / of length 2~^ with dist(x, 9J„) > and each J„ is of 

the form J„ = /g"(/) for some 

Step 2. We let po be the standard Lebesgue measure on I and consider the 
induced IMS pn = /g'Mo- By construction, pn is the normalized Lebesgue 
measure on the interval foil). Now pick x G (0,1) and choose rig according to 
the result of Step 1. Then for all n > uq we obtain 

PkA{x - 2-("+2),x]) = PkA[x,x + 2-("+2)]) = 2-("+2)2" = 1/4. 

Now assume to the contrary that SuiPoo) contains a constant sequence Vn = 
V — {/i,...,/r} with subintervals Ii < I 2 < • ■ • < Ir satisfying \Ij\ < 1 for 
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j = 1,..., r. Then there exists x* € (0,1), which is a common boundary point 
of two of these subintervals, say Ii and l 2 - Let no = no(x*) be chosen according 
to Step 1. To disprove that Vn = V is admissible, consider e := 1/8. Assume 
to the contrary that there are (5 > 0 and compact sets Knj C Ij such that 

(i) X G and y G implies \x -y\> 5, if ji ^ j 2 , n G No, 

(ii) y,n{Ij\Knj) < e = 1/8 for all n > 0. 

Property (i) implies that for each n, contains [x* —(5/2, x*], or l 2 \Kk „,2 

contains [x*,x* +5/2]. Choose n > no large enough that <6/2. Then 

fik,,ih\Kk„,i) > Aife„([x* - 5/2, X*]) > - 2“(”+^\x*]) = 1/4 > e 


or 


y-k„il 2 \Kk„, 2 ) > ^J^k„i[x*,x^, + 5/2]) > /ife„([x*,x* + 2 ("-+2)]) = 1/4 > e, 

in contradiction to (ii). Since |//,(x)| < 1 for all n, foo is equicontinuous. □ 

We will now return to the general, possibly non-stationary, sequence of spaces 
Xao = {Xn)//Lo- We are in position to prove the following extension of the 
product theorem (item (hi) in Proposition 13.51) . 

3.17 Proposition: Let the assumptions of Proposition l3.5K iii) be satisfied. 
Then, under each of the following three conditions, equality holds in ([5|: 

(a) hstjiigoo) = 0. In this case, 

^Smifoo X goo) = ^£m(/oo)- 

(b) One of the systems is autonomous, say (Tn,ffn,t'n) = {XtUX)- Li this 
case, 

^£m(/oo X goo) — hgy^)foo) + h,y)g), 
where hy{g) is Kolmogorov-Sinai entropy of g w.r.t. v. 

(c) (.Xoojfoo) — (Loo?i?oo) and Poo — ^oo- Li this case, 

^Syiifoo X foo) — ‘2h£y^(^foo). 


Proof: For (a) we only have to show h£^{foc x goo) > /ism(/oo)- To this end, 
consider 7 r„ : XnXYn A„, (x, y) x. This sequence is an equi-semiconjugacy 
from foo X goo to foo- Then the inequality follows from |K11 Prop. 27]. 

To show (b), let Poo G £M(fJ-oo) and let Q be a finite measurable partition of Y. 
As in the proof of Proposition I3.5f iiil we conclude 


Hfoo X 5 ; Poo X Q) = limsup 

n—>oo ■ 


H„ 


n—i n—i 


z=0 


2=0 
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Using the inequality limsup„(a„ + bn) > limsup„ Un + liniinf„ bn, we obtain 
Hfoo X- g;'Poc X Q) > limsup-i/^o( W fo’‘'Pi) + lim -H^( W g~"Q), 

n—^cxi ^ ^ ^ ^ n—¥oo Ji ^ ^ 

2=0 2=0 

because for an autonomous system the limit in the above expression exists. Now 
let i'P^)T=o ^^el (Q^)^o l^e fine-scale sequences, where £ Suig-oo)- Then, 
from the above it follows that 


*£m(/.*=oXi.)(/oo X g)= lim h{f^ x g-,V^ x Q'^) 

k—^oo 

> lim h{f^;V^) + lim h{g; Q!") 

k—^oo k—¥oo 

— ^£m(mcx,) (/oo) + b,i,{g), 

where we use Corollary 13. 101 Together with Proposition I3.5f iiil. (b) is proved. 
Finally, to prove (c), note that for any admissible Voc we have 

Hfoo X foo^Voo X Too) = 21imsup-i7^o[ Y = 2/i(/oo; U’oo)- 

n—^OQ Tl ' • rv ' 

2=0 

By considering a fine-scale sequence > 1-1^® assertion easily follows. □ 

In the classical theory sometimes it is sufficient to compute the entropy on a 
single partition, which is therefore called a generator of the entropy. This is 
the case, e.g., if the given map is expansive. In [K2] we introduced the notion 
of strong uniform expansivity for nonautonomous systems. The next result 
shows that this condition guarantees the existence of a generating sequence of 
partitions, provided that the IMS is sufficiently nice. 

3.18 Corollary: Let {Xao,foo) be a topological NDS which is strongly uni¬ 
formly expansive, i.e., there is S > 0 such that for any e > 0 there is N £ N 
with 

max dn-^^(fHH,fn(y)) < ^ dn(x,y) <e 

0<z<N 

for all n > 0. Let poo be an IMS for foo and assume that £m{Poo) contains a 
sequence Voo with diamPoo < 5. Then poo is a fine-scale IMS and 

b'Hoo, Poo) — b(y*oo , P'00 : ^oo) • 

Proof: We consider the sequence Vn'^ = \J\Zq fH^^n+i- According to 

|K1[ Def. 15 and Prop. 26], V^'' £ £m and by |K1[ Prop. 9(v)], h{foo',V^'') = 
Hfoo', Voo)- Hence, if diamPi^^ —^ 0 for /c —)• oo, then Theorem 13.31 yields the 
result. Let 0 yf P £ for some k and n. Fix arbitrary x,y € P. Then, for 
i £ {0,1,..., fc — 1}, fnH)>fniy) ^.re contained in the same element of Vn+i, 
implying d„+i(/^(x), fHv)) < b for i = 0,..., k - 1. For k = k{s) large enough, 
this implies dn{x,y) < e. Hence, diamPi^^ < e, completing the proof. □ 
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4 Nonstationary subshifts of finite type 


In this section, we consider the time-dependent analogues of subshifts of finite 
type (topological Markov chains) studied in [AFl IF] by Arnoux and Fisher. We 
start with some definitions. 

Let {Ai)^Q be a sequence of finite alphabets Ai = {1,..., 1^}. Consider also a 
sequence of 0-1-matrices (Li)fco of corresponding dimensions k x U+i. For any 
nonnegative integers n < m we write 

w{n,m) := {{xn, ■ ■ ■ ,Xm) ■ Xi e A and = 1, n < z < to - l} . 

Furthermore, we make the following assumptions: 

(Al) The sequence (Li)^o reduced, meaning that none of the rows or columns 
of each Li is identically zero (cf. [0 Def. 2.1]). 

(A2) The sequence {k)^o of alphabet sizes is bounded. 

It is easy to see that the following properties are satisfied: 

(Wl) w(n,n) = In- 

(W2) w{n, m + 1) > w{n, to) for all m>n. 

(W3) w{0, n + m) < w(0, n)w(n -\-\,n + to) for n > 0, to > 1. 

Now we define a sequence of spaces k >0,hy 

. — ■( (xfc, ;^fc + 2 ;---) • Xi ^ Ai and {Li^xiXi^x — 1; ^ 1 

and a sequence of maps by 

^ ^(L) ’ ;^fc + l;^fc + 2;---) — ,...). 

That is, CTfc is the usual left shift of sequences, restricted to On we 

define a metric dk by 

( 0 ii X = y 

dkix,y):=< 1 ifxoT^yo 

[ w{k, l)~^ if I = max{r > k : Xi = yi, z = fc,..., r} 

for any two x = {xk,Xk+i, ■ ■ ■) and y = {yk,yk+i, ■ ■ ■) in The proof of 

the following proposition uses standard arguments and will be omitted. We just 
note that for the equicontinuity of CToo assumption (A2) is essential. 

4.1 Proposition: (E^£^,d/c) is a compact metric space and Ok is surjective. 
Moreover, the sequence Ooo '■= (o'fc)^Q is equicontinuous. 

4.2 Definition: Following Arnoux and Fisher )AF| . we call the topological 

NDS (Too) a nonstationary subshift of finite type, or briefly an NSFT. 

Moreover, we introduce the notation ■= LkLk+i ■ ■ ■ Ln-i for n > k. 
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4.1 Topological entropy 

In this subsection, we give a formula for the topological entropy of an NSFT. 
The proof of the following lemma is completely analogous to the stationary case. 


4.3 Lemma: For each n > 1, the number of admissible words (xg, ■ • ■, Xn) with 

Xi € Ai such that xg = a and Xn = P for fixed a € .4-0 8,nd p £ An, is equal to 
the matrix entry . 

4.4 Definition: Given e > 0, define for each n > 0 

w„(e) := min-fm > 0 : w{n,n + m)>—\. (7) 


4.5 Theorem: The topological entropy of an NSFT is given by 

/itop(CToo) = limsup - log w(0,n) = limsup - log (8) 

n->-oo n n-s-oo Tl 

where || • ||(„) denotes the norm on R'ox'" given by ||4||(„) = J2a,is l-4a/3|- 


Proof: If is finite, the assertion is trivial, and hence we assume = 

oo. The existence of m„(£) for every e is equivalent to limfe_>oo w(ji,n + k) = oo, 
which is equivalent to = oo. By assumption, this holds for n = 0. 

Because r/;(0, n +fc) < w(0,n — I)w(n,n + A:), it holds for every n. We first prove 

/itop(o-oo) = lim limsup - logr(;(0,n + m„(£)). (9) 

e\0 

n—¥oo ^ 

For fixed n G N and £ > 0 let m„ = mn{e) and consider a set FI C 
containing for every admissible word {xg, ... ,Xn+mn) a unique y G ^(l) with 
yi = Xi for 0 < i < n + m„. Then = ■u;(0, n + to „) and any two x ^ y in E 
must differ in at least one of their first n + + 1 components. The maximum 

dgAx,y) = max dj{al{x),al{y)) 

0<j<n 


is equal to 1 if a; and y differ in one of their first n + 1 components. If the 
(n + l)-th component (I < Z + 1) is the first in which they differ, then 


dj{al{x),al{y)) = 


I 


> 


1 


(j, n + /-I) w{j,n + mn) 


Consequently, 


dg,n{x,y) > 


1 

max —--- 

0 <j<n w(j, n + TO„) 


I 

w(n, n + mn) ’ 
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which easily follows from assumption (Al). This inequality is also true in the 
case, where x and y differ in one of their first n + 1 components. By definition 
of m„(e), it follows that w{n,n + irin — 1) < 1/^ in the case where mnis) > 0 
(which we assume w.l.o.g., since otherwise ui(n, n + run) = In, which is bounded, 
and we are only interested in small s). Thus, 


do,n{x,y) > 


> 


w{n,n + mn) r(;(n, n + — !)!„+„ 


> 


SUp„ In ’ 


implying that E is an (n,e/(sup„ (-separated set, and hence 
htop(o'oo) > lim limsup - logr(;(0, n -f mn{e)). 

n—¥oo ^ 


Choosing y € E ior a given x G such that Xi = yi for f = 0,1,..., n -I- m„, 
we find 


doA^^y) = max dj{alix),A{y)) < — - \ -- 

o<j<n w(n,n + mn) 


< 


and hence E is (n, e)-spanning, implying the inequality “<” in (jH). Note that 
w(0, n + ninis) — 1) < ^^(0, n — l)ui(n, n + mn{s) — 1) < rc(0, n)-. 


following from (W3). Consequently, we obtain 


1 


lim sup — log w(0,n + mn{e)) 

n—yoo ^ 

< limsup — log (w(0, n + iTin{s) — l)ln+ m„(e)) 

n—¥co ^ 

< limsup-log (il„+„„(e)w(0,n)) . 

n—¥oo Tl \S J 


Since {lnA=o is bounded by assumption (A2), the inequality “/itop(o'oo) < ■ • 
in (fS]) follows. The other inequality trivially follows from ®. The second 
equality in (|S]) is an easy consequence of Lemma I4.3I □ 


4.6 Remark: (i) In the second expression for htop{(7oo) in ® we can also use 
the operator norm || • ||iqn) coming from the vector norm ||x|| = \xi\, for 

instance. This follows from the equivalence ||A||i_(„) < ||A||(„) < and 

boundedness of In- Indeed, any of the usual operator norms will do, because 
they are all equivalent to each other, and the equivalence factors depend on the 
dimensions of the spaces, which vary within a finite set. 

(ii) Since (Too is an equicontinuous sequence of surjective maps, we know from 
Proposition I2.1I that htop{o'k,oo) = htop{<Ji,oo) for any k,l > 0. From the for¬ 
mula of the above theorem this can also be seen directly. Indeed, it holds that 
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w{l,n) < w(0, n) < low{l, n), where the first inequality is trivial and the second 
one follows from (W3). This implies 

limsup — logiy(0,n) = limsup — logri;(l,n) = limsup — logi(;(l,n + 1), 

n—^oo n—foo n—^oo 

and hence /itop(o'o,oo) = ^top(CTi,oo)- The rest follows inductively. 

(iii) In particular, the entropy formula shows that htop(o'oo) is finite, since 
k) < h ^ with L := sup;.>Q Ik, and hence ft.top(<Too) < logT. 

4.2 Metric entropy 

Now we turn to the computation of the metric entropy with respect to an 
appropriately defined IMS. The definition is taken from Fisher [F] who writes: 

... ice shall find that many things carry over more or less directly from the 
stationary case. For example, the measure of maximal entropy of a subshift of 
finite type has a very simple formula discovered by Shannon in an information 
theory context (■■■), involving the left and right Perron-Frobenius eigenvectors 
of the matrix (the proof that this maximizes entropy within the Markov measures 
is due to Shannon, while Parry in [... ] showed that Shannon’s measure gives 
the maximum over all invariant probability measures; ... We follow standard 
usage in calling this the Parry measure. Here (without worrying about how to 
define entropy for seguences of maps) we simply replace these eigenvectors by 
eigenvector sequences, and define a nonstationary Markov chain which gives us 
an exact analogue of the Parry measure. The formula gives us a sequence of 
measures on the components, invariant in the sense that one is carried to the 
next by the shift map. 

Hence, Fisher defines an IMS for an NSFT, which is constructed analogously 
to the Parry measure for classical subshifts. The aim of this subsection is to 
compute the metric entropy of this IMS and to compare it with the topological 
entropy. 

Given Xi G Ai for k < i < m, we define the cylinder set 

[.Xk...x.,y,] := |i/ = (y/c, J/fe+i, ■. ■) G : Pi = Xi, i = k,... ,m'^ . 

We also define for each 0 < k < m the partition 

Pk ■ • • ■ ^m] ■ G Ai and f j k % 'fi. m } ■ 

4.7 Proposition: Let /loo be an IMS for a^o and let mk{s) be given by ©■ 
Then, for any e > 0 the sequence Poo,e = {Pk,e)'^o, Pk,e '■= is 

admissible and diamPoo.e < £• Hence, every IMS for CToo is a fine-scale IMS. 

Proof: The number of elements in Vk.s is equal to w{k, k-\-mk{e)) and w{k, fc + 
rrikie:)) < w{k,k + mfe(e) — I)4+mfc(e) ^ (supj.Zfc)/e- It is clear that Vk,e is a 
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partition of It is easy to see that the cylinder sets are closed and hence 

compact. If x,y G ’^^l) distinct elements of Vk,e, these sequences 

differ in at least one of their first TOfe(e) + 1 components, and hence 


dk{x,y) > 


> 


> 


w{k,k + mk) w{k,k + mk{e)-l)lk+mkie) sup^.lk 


Obviously, this implies Poo,e G £m(Moo)- For the distance of two points x,y G 
Vk,e we obtain dk{x, y) < w{k, k + mk{e))~^ < e, concluding the proof. □ 

With Theorem 13.31 we obtain as an immediate consequence: 


4.8 Corollary: For every IMS /ioo of doo we have 

^((^00, /ioo) — lim hiyJoQj /ioo, oo,e:)- 

e\,0 

The following definition, (its first part is taken from [FI Def. 2.3]) generalizes 
the concept of primitivity for single matrices. 

4.9 Definition: The sequence (Ti)^o called primitive if for each i > 0 there 

exists n > i such that all entries of are strictly positive. We denote by 
Ni the least integer n such that all entries of are strictly positive and call 
the sequence uniformly primitive if the sequence (A^i)i^o bounded. 

In the rest of the subsection, additionally to (Al) and (A2), we assume that 

(A3) The sequence (Ti)“o primitive. 

4.10 Definition: Given a sequence (Ai)^p of k x nonnegative real matri¬ 

ces, a sequence (vi)^Q of nonzero column vectors satisfying AiVi+i = \iVi or 
row vectors satisfying vlAi = with nonzero numbers \i, for all i > 0 is 

called a column or row eigenvector sequence with eigenvalues A^. 

We write for the positive cone in i.e., the set of all column vectors with 
nonnegative entries only. For the matrix sequence (Li)^Q we define 

^(L) := {woo = (wi)“o with = LiW^+i and Wi G intC'+} . 

Analogously, we write for the positive cone in i.e., the set of all row 
vectors with nonnegative entries only, and we define 

^(L) := {vL = (v!))^o with v‘L, = and v, G int i?+} . 

The following lemma can be found in |F1 Lem. 4.2]. 

4.11 Lemma: For a reduced and primitive sequence {Li)'i^Q the sets and 

nonempty. A sequence in is determined by choosing a strictly 
positive first element Vq. If (wi)“g G then ||wi|| > ]|wi+i]| for i >0. 
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We take some Woo S ^{l) and project each component to the unit simplex: 


Wi 



w|| = |(w)a|. 

a 


We then normalize the sequence of row vectors in a different way which depends 
on the choice of Wqo: we define (v-)“q by 


Since the entries of are strictly positive, we are not dividing by zero. We 
define real numbers Xi = Ai(woo) by Xi := ||wi||/||wi+i|| > 1, and we have 


LiWi_|_i = XiWi for all j > 0. 

A direct calculation as in |Af 1 Lem. 4.3] yields the following fact. 


4.12 Lemma: Let S and (v-)“g G and let and 

(v-)“g be the corresponding normalized sequences. Then (v*)^q has the same 
eigenvalues as (wi)“g. 


From a choice w^, v* we now define a nonstationary Parry measure. First we 
define a sequence of row vectors tt^ = (7r|)“g by 

(7r*)a := (vi)„(wi)a, a = l,...,li, i>0. (10) 

The entries of tt* are strictly positive and = 1- Then we put Pi := 

(l/Ai)lF“^LiWi+i, where Wi is an (li x Zi)-diagonal matrix with the entries of 
Wi on the diagonal. Each Pi is a stochastic matrix and 7r|Pi = for i > 0. 
For k < m we put 


^ Pk,rn) _ 
(w) 


1 if fc = m 

otherwise 


( 11 ) 


and notice that 


= Aj^j^wo and f > 1. 


(w) 


( 12 ) 


A probability measure on is defined on cylinder sets by 


Pkil-Xk ■ ■ ■ Xm]) ■ — i,T^k)xk (Tfe) 


^k^k+1 




~ .(k,m)^^k)xki'^m)a 


(w) 


and extended uniquely by cr-additivity. Any such poo is called a Parry IMS. 
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In what follows, we say that 7 G Ak maximizes the sum if 


= max { ^ Ly ^ : /3 £ A } ■ 

cx. a 

We recall that mk{e) = min{m > 0 : w{k, k + m) > from 0 and introduce 

the notation 

nfe(e) = k + mk{e), nk{e) = max {i + mi{e)) for /c > 0 and e > 0. (13) 


Our main results about the metric entropy of NSFT’s are the following. 

4.13 Theorem: Let aoo) be an NSFT and /ioo an associated Parry IMS. 

(i) The following inequalities hold: 

limsup i logA^”’'"^ < h{aoo,hoo) < limsup ^ log ||T^°’''^||(fe). (14) 

k—¥oo ^ k—¥oo ^ 


(a) The inequalities in (ini) are equalities, and hence h(aoo,Moc) = ^top(<7oo), 
provided the following assumption holds: There exist e > 0 and fcg £ N 
such that for all k > ko and m such that w{k,k + m) > 1 /e for each 
7 £ Ak which maximizes inequality holds for 

all /? £ Ak+m- 

(Hi) Another sufficient condition for the equalities in (d is 

limsup — log = 0 , 

k—¥oo ^ 

where Nk is the smallest integer n such that all entries of 

strictly positive. In particular, this holds if {Li)’^Q is uniformly primitive. 


Proof: (i) The second inequality in (1141) follows from © and Theorem 14.51 
To show the first one, we first observe that the sequence ('Pfc)^Q of cylinder 
partitions is admissible, since = Ik is bounded and the distance between 
two elements [.Xk] and [.yk] of V^, Xk ^ yk, is 1. Hence, 




2=0 


E 

[.Xo...X„ 


A(o>"’) 


(Vo)r^o(Wn)x„ log ( 


y(0,n) 


(Vo)^o(Wn);r 


-) > log 


^(O.n) 


maxa(v(|)„’ 


where we use that the components of w„ are bounded by 1 and /tq is a probability 
measure. Dividing by n and letting n go to infinity gives the desired estimate. 
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(ii) It suffices to show that 

limsup i log > limsup ^ log 

k—¥oo ^ k—¥oc ^ 

To this end, let Uk = nk{e) and observe that = A^°’”'“Wo yields 

a,(3 

Choose 7 ' that maximizes Then, using the assumption, 




A) I 


where || • ||i is the operator norm derived from the ^^-vector norm. Writing 
II • ||(„) for the sum norm, this implies 

||L(0A)||i ||L(oA)||^ 


A( 0 ,*) ^ 


> 


Xik,u,) - ||L(fe.n.)||(^^^ 


w{k,nk) 


SUPi k 


||L(°-' 


Using that all norms on a finite-dimensional space are equivalent and the equiv¬ 
alence factors stay bounded when the dimensions vary within a finite set, we 
obtain the assertion. 

(iii) From L(0’'=+"'=)wfe+Ar, = L(o>'=)L('=’'=+"'=)wfc+Ar, = A(°’'=+^'')wo we get 
Xio,k+N.) ^ A(°’'=+^^)||wo||= 

Oi,-y,p V 

> ||T(°’'=)||(fe)||wfc+^J| = ||L(°''=)||(,). 

This implies the first assertion in (iii). If {Li)^Q is uniformly primitive then the 
sequence (iVfe)^p is bounded, and since Xi < ||Ti||(i) < (sup^k)'^, this implies 
that the sequence is bounded. □ 

4.14 Theorem: Let aoo) be an NSFT and /ioo an associated Parry IMS. 

(i) With the notation (ITUl) and (IT^ . we have 

/i(ctoo,Moo) = linilimsupi^(7rfi(^(£))/3log^L 

^\i 0 k —^00 ^ a 


(0,nfe(£)) 

q:/3 


(15) 


(ii) The following condition is sufhcient for the equality of /i((Too, Moo) and 
/itop(o’oo)- For every 6 G (0,1) there exist £ > 0 and fco £ N such that 
for all k > ko and each 7 G Alfc which maximizes the in¬ 
equality > 1 holds for all fd in a set B C satisfying 

J2/3eBi'^nk{e))0 > 1 — < 5 . 
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Proof: (i) Let us consider the cylinder partition Vq. Without loss of generality, 
we may assume that Vq is the vector all of whose entries are ones. Using Lemma 
lOl and (US, we compute 




[.Xo...Xk] 
1 


A(o.fc) 


(Vo)xo(wfc)^,,log-;^ 


A(o.fc) 


'OJXQ 


(Wfe)a; 

A(o.U 




= jm E (wfc)., log j— 

Xk Xq ^ ^ 

= i«e ‘«e -pg;; 

Xk Xk 

= =-ff(7r/c) + E(^fc)/3logE-^«T^’ 

Xk ^ P ot 

where H{-Kk) is the entropy of the probability vector -Kk- Corollary 14.81 yields 

1 ^ 

/i(CToo,/ioo) = limlimsup-iL^o( \J a^^ViA- 

£\j0 t*_irv-i rC ^ ' 


i=0 


Now fix an e > 0 and write Uk := k + mk{s). An element of ViLo 
has the form H^o ^ sequence x is contained in this set 

iff cro(^) S (e)] “ 0,1,..., fc. This is equivalent to Xi+j = 

[crQ{x)]j = a;^ for 0 < i < /c, 0 < j < mi{£). But this implies 


k 

V = K”- 

i=0 

Replacing k with nfc(e) in (fTC|) and observing that 0 < H['Kk) < logsupj>Q li for 
all k, formula m follows. 

(ii) To prove the equality h{aao, ^J^ao) = /itop(o'oo) under the given condition, 
first observe that nfe(e) > fc + mk{e) implies that 


k 

\J is finer than ■ 

i=0 

Consequently, ^ (^oand, after replacing nfe(e) by 

nfc(e) in USD, the right-hand side is still a lower bound for the entropy. For a 
given 5 G (0,1) we choose £ > 0 according to the assumption. We can write 

Q! a,7 
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Choosing 7 ' that maximizes the sum La'y^\ our assumption gives 

forall/3eS, 


where B is a set with Yjp^B{'^nk{e))li > 1 - We have X^a ^ 
where || • ||i is the operator norm derived from the £^-vector norm. Hence, 

h{aoo,fJ.oo) > limsup^ E II 1 


k—^co 


I3£B 


> {1 — S) limsup y log I 


k—^oo ^ 


= (l-,5)limsupEog||L(°’'=)| 

k—yoo ^ 


(ky 


where we use that all norms on a finite-dimensional space are equivalent and 
the equivalence factors stay bounded, when the dimensions vary within a finite 
set. Letting <5 \ 0 we obtain h{a 00 , y-oc) > htopiuoo), using Theorem 14.51 The 
opposite inequality is satisfied by ©. □ 


4.15 Remark: Condition (ii) in Theorem 14.141 is an asymptotic version of con¬ 
dition [TTSjii). If we interpret the NSFT as a time-dependent communication 
network, this condition (roughly speaking) says that the best receivers of mes¬ 
sages are also good broadcasters. We can easily check that in the stationary 
case an even stronger property is always satisfied. Indeed, let L be a quadratic 
I X I reduced and primitive 0-1-matrix. Pick p such that all entries of are 
positive. The sum norm satisfies ||L"+^|| > ||L"'|| for all n. Now take e > 0 
with IlL^II < 1/e. Hence, if w{0,m) > 1/e, then ||T"*|| = w{0,m) > ||T^||, and 
consequently m > p, implying that all entries of T™ are positive. 


Finally, we present an example of an NSFT satisfying /itop(o'oo) = h(aoo, Pcx>), 
which violates assumption (iii) in (14.1311 . Hence, we see that this assumption is 
only sufficient, but not necessary. 

4.16 Example: We consider a sequence (Ti)“o of the form 

A[B--- B]k,A[B ■ • • B]k,A[B • ■ • B]k,A ..., 

where [B ■ ■ ■ B\k stands for a finite sequence of k copies of B, is an 

unbounded sequence of positive integers, and 

/ 1 1 1 \ / 1 1 0 

A = i 1 1 1, B=1 1 0 

\ 1 1 1 / \ 0 0 1 

To compute the relevant quantities for the associated NSFT, first observe that 


/ 2'=-! 

2^-1 

0 \ 1 

( 2^ 

2k 

1 \ 

Bk ^ 2'=-! 

2fc-i 

0 , ab’^ = 

2k 

2k 

1 

\ 0 

0 

1 / ' 

V 2^ 

2k 

1 / 
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By induction, one proves that 


2^1 2 '=! 1 

2^1 2 '=i 1 

2^1 2 '=i 1 


2fe. 2'^- 1\ n-i ( 2'^- 2'^- 1 

2 fc„ 2 ^=^ 1 =n(l + 2 '=^+') 2 '=’^ 1 

2fcn 2^=- 1 / i=i \ 2^=" 2^=" 1 


Computation of the norm growth rate: From the assumption that {ki)i^i is 
unbounded it follows that f{n) = X]r=i grows faster than any linear function. 
Together with the estimates 2^“+^ < 1 + 2^*+^ < 2^’+^, we obtain 


lim - 

n—¥oc n + 


1 ^ 

, log2fe" l[{l + 2>^^+^ 

2^i=i 


) = log 2. 


To see that the growth rate on any other subsequence (/„) cannot be larger than 
log 2, assume 

LioM = 0 < < fc„(„)+i. 

The associated growth rate satisfies 


log2’’"n™^rHl + 2'=^+^) 

%{n) 


lim sup 

n^co m[n) + ' ki + l + -. 


n^oG (X;™ r h + rn) + m{n) + 1 


Since grows faster than linear, we see that log 2 is an upper bound for 

the above expression, and hence the growth rate of is log 2. 

Computation of the eigenvalue growth rate: The vector is an element of 
L(*>®+")C'X„ (cf. [H Lem. 4.2]) In the case Li = A, i.e., i = 0, fci + l,fci + 
fc 2 + 2,..., this intersection reduces to the ray {A • (1,1,1)”^ : A > 0}, and hence 


1 


1 


Wj = - 1 , i = '^kj + n, n e N. 


1 / i=i 

The equality implies 

2 '=" \ , / 1 


1 


1 




1 = fc3+".E"=i kj+n)^ 


1 / " \ 1 
Taking the norm on both sides gives 


z 27 =i kj+n- 


= i kj+n,kj+n) _ _ ^ 2 ^n + l _j_ 

3 


(17) 


To compute the growth rate of A1°’"1, we also determine the numbers 
Ao, Afei+i, Afei+fe 2 + 2 ,.... From LiW^+i = A^Wi we get 


A^i:7.jkj+n+i = lxj:uk,+r, 
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Looking at this equation componentwise, we see that 1 = = 

(l/3)Aj;-^^ k.+n, and hence kj+n = 3. Consequently, for l{n) = J2j=i % + 
n we obtain = 0”=! (2^*'*'^ + l)- Since grows faster than any 

linear function and < 2 ^*+^ + 1 < 2 ^*+^, we obtain 


1 1 " 
lim — logA(°’'(”» = lim — y log(2'=^+i + 1) 

i.—^ro 1{ti) n.—^oo lln\ • ^ 


Kn) j 


2=1 


= lim -^y(A;j + l)log2 = log2. 

n-)-oo i[n) ^— ' 

^ ' i=l 


With the same reasoning as in the case of the norm growth rate, one shows that 
log 2 is actually equal to limsup„(l/n) logA^^’"! 

Assumption (in) in Theorem 4.13 is violated if ki = 2*; Observing that for 
i = n + % + 1 we have Ni = fc„+i + 1 = 2"+^ + 1, and using (fT71) . we 

obtain 

J^ii.i+Ni) ^ y(E"=iO+»"+l.E"=i‘fe3+("+l) + l) 

^ fcj+(n+l) + l k,+n,y^^A4 0+(» + l)) > ^2fe" + l + l + 1) 

with a constant c > 0. Now limsupj^oo i log > log 2 follows easily. 


5 Open questions 

We end with a list of open problems that we were not able to solve and we think 
are interesting for further research. 

(1) Does there exist any IMS which is not a fine-scale IMS for a topological 
NDS with uniformly totally bounded state space? 

(2) Are there easily checkable conditions under which condition (ii) in Theo¬ 
rem [3^ is satisfied? 

(3) Under which conditions can an IMS be transformed in the sense of Corol¬ 
lary 13.131 to obtain a countable number of non-equivalent limit points? 

(4) Are there examples of NSFT’s, for which the topological entropy is strictly 
larger than the entropy of any Parry IMS? If so, do these systems still 
satisfy the full variational principle? 
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